Skip to content

Add per-model response length overrides - #1144

Merged
paullizer merged 2 commits into
Developmentfrom
paullizer-model-response-length-overrides
Aug 3, 2026
Merged

Add per-model response length overrides#1144
paullizer merged 2 commits into
Developmentfrom
paullizer-model-response-length-overrides

Conversation

@paullizer

Copy link
Copy Markdown
Contributor

Summary

  • Add optional responseLength normalization for multi-endpoint model rows and preserve compatibility with existing endpoint records.
  • Add an admin model-endpoint UI field for per-model response length and serialize it with endpoint model settings.
  • Apply the selected model's response length to standard chat completions with max_completion_tokens for GPT-5/o-series aliases and max_tokens otherwise.

Validation

  • python -m py_compile application\single_app\functions_settings.py application\single_app\model_endpoint_clients.py application\single_app\route_backend_chats.py functional_tests\test_model_endpoint_normalization_backend.py functional_tests\test_streaming_multi_endpoint_resolution.py functional_tests\test_model_endpoint_protocol_inference.py functional_tests\test_model_endpoints_api_key_manual_models.py ui_tests\test_model_endpoint_request_uses_endpoint_id.py
  • node --check application\single_app\static\js\admin\admin_model_endpoints.js
  • python functional_tests\test_model_endpoint_normalization_backend.py
  • python functional_tests\test_streaming_multi_endpoint_resolution.py
  • python functional_tests\test_model_endpoint_protocol_inference.py
  • python functional_tests\test_model_endpoints_api_key_manual_models.py
  • python functional_tests\test_model_endpoint_model_icon_picker.py
  • python functional_tests\test_model_endpoints_save_button.py
  • python -m pytest ui_tests\test_model_endpoint_request_uses_endpoint_id.py -q (skipped without UI env)
  • git -c core.whitespace=blank-at-eol,blank-at-eof,space-before-tab,cr-at-eol diff --check

Fixes #1143
Related to #1047, #358

paullizer and others added 2 commits August 3, 2026 08:05
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@paullizer
paullizer merged commit e70be3a into Development Aug 3, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant